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DETAILED ACTION 

Response to Arguments 

1 . Applicant's arguments with respect to claims 1 , 3-23, and 27-32 have been 
considered but are moot in view of the new ground(s) of rejection. 

2. The 35 USC 101 rejection made in the previous Office Action has been 
withdrawn due to Applicant's amendments. 

Claim Rejections - 35 USC § 103 

1 . The following is a quotation of 35 U.S.C. 1 03(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

2. The factual inquiries set forth in Graham v. John Deere Co., 383 U.S. 1 , 148 
USPQ 459 (1 966), that are applied for establishing a background for determining 
obviousness under 35 U.S.C. 103(a) are summarized as follows: 

1 . Determining the scope and contents of the prior art. 

2. Ascertaining the differences between the prior art and the claims at issue. 

3. Resolving the level of ordinary skill in the pertinent art. 

4. Considering objective evidence present in the application indicating 
obviousness or nonobviousness. 

3. Claims 1 and 3-23 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Gounares et al., US 2003/0215142 A1 and further in view of Arai 
etal., US 6,421,461 B1. 
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Regarding claim 1, Gounares teaches a method, comprising: receiving 
electronic ink input; converting the electronic ink input to one or more machine- 
generated objects; and rendering the one or more machine-generated objects using a 
determined size for the machine-generated object or objects and an original inter-word 
spacing of the electronic ink input (Figs. 5 and 6, [0037], The examiner takes into 
account that "printed text" corresponds to "machine-generated objects, and that the size 
and inter-word spacing is substantially equal to the original size of the electronic ink 
input as seen in Figures 5 and 6.). However, Gounares does not teach calculating a 
maximum height of corresponding electronic ink input and setting the size of the one or 
more machine-generated objects to be equivalent in scale for the calculated maximum 
height. Arai teaches determining the size of and entry of handwritten data (such as the 
maximum height), and then outputting a candidate character of relative size (Figs. 25 
and 29, col. 10, lines 12-23). The Examiner takes into account that as in the Applicant's 
specification which discloses, for example, that "the average height (or other size 
characteristics) of the various ink characters may be determined...," and thus since an 
average height is determined (normalization) it includes a step of determining a 
maximum height. As in Arai since the maximum height is also used in an equation to 
determine the output, it would be obvious to one of ordinary skill in the art at the time of 
the invention to use the maximum height of the input for the height of the output. It 
would be clear to one of ordinary skill in the art to modify Gounares to include outputting 
characters based upon the maximum height input so that certain handwritten characters 
are displayed with emphasis. 

Regarding claim 3, Arai teaches wherein the size of the one or more machine- 
generated objects is determined by calculating an average height of at least a portion of 
the electronic ink input (Figs. 25 and 29, col. 10, lines 12-23). 

Regarding claim 4, Gounares teaches a method according to claim 1 , further 
comprising: receiving input selecting at least one object from the rendered machine- 
generated object or objects; and displaying the electronic ink input corresponding to the 
selected machine-generated object or objects in place of the selected at least one 
object (Fig. 5 and [0037]). 



Application/Control Number: 10/725,604 
Art Unit: 2624 



Page 4 



Regarding claim 5, Gounares teaches a method according to claim 4, wherein 
the displayed electronic ink input temporarily replaces the rendered machine-generated 
object or objects ([0037] and [0041], The examiner takes into account that since the 
InkEdit control can display either the original ink or the recognized text or both, that it is 
clear that the electronic ink input can temporarily replace the rendered machine- 
generated text.). 

Regarding claim 6, Gounares teaches a method according to claim 1, wherein 
the one or more rendered machine-generated objects are arranged so as to correspond 
to an original arrangement of the electronic ink input (Figs. 5 and 6, [0037]). 

Regarding claim 7, Gounares teaches a method according to claim 1, wherein 
the electronic ink input includes electronic ink text input, the one or more machine- 
generated objects includes machine-generated text, and the size of at least some of the 
machine-generated objects constitutes a font size of the machine-generated text (Figs. 
5 and 6, [0037]). 

Regarding claim 8, Gounares teaches a method according to claim 7, further 
comprising: determining the original size of the electronic ink text input on a word-by- 
word basis: wherein at least two words are separated by said original inter-word spacing 
(Fig. 3, and [0040], The examiner takes into account that since size can be determined 
by the InkEdit control, and since some ink can be selected by creating a box, it is clear 
that each word can be selected and the size of that word be determined while keeping 
the original inter-word spacing.). Arai teaches determining the size of and entry of 
handwritten data (such as the maximum height), and then outputting a candidate 
character of relative size (Figs. 25 and 29, col. 10, lines 12-23). 

Regarding claim 9, Gounares teaches a method according to claim 8, wherein 
the machine-generated text is rendered, on the word-by-word basis, at a font size based 
on the determined original size of the electronic ink text input (Figs 3-6, [0039-0040]). 
Arai teaches determining the size of and entry of handwritten data (such as the 
maximum height), and then outputting a candidate character of relative size (Figs. 25 
and 29, col. 10, lines 12-23). 
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Regarding claim 10, Gounares teaches a method according to claim 7, further 
comprising: determining the original size of the electronic ink text input as an average 
size of a line of the electronic ink text input ([0029], "The color and/or font size of the 
textual ink, as well as whether the textual ink should be underlined, bold, italic, and/or 
the like may be set programmatically and may be based on the attributes of the text 
around the tink object."), on a line-by-line basis, wherein at least one line includes at 
least two words separated by said original inter-word spacing (Fig. 3, and [0040], The 
examiner takes into account that since size can be determined by the InkEdit control, 
and since some ink can be selected by creating a box, including an entire line, it is clear 
that each word can be selected and the size of that word be determined while keeping 
the original inter-word spacing.). Arai teaches determining the size of and entry of 
handwritten data (such as the maximum or average height), and then outputting a 
candidate character of relative size (Figs. 25 and 29, col. 10, lines 12-23). 

Regarding claim 11, Gounares teaches a method according to claim 10, 
wherein the machine-generated text is rendered, on the line-by-line basis (Fig. 3, and 
[0040], The examiner takes into account that since size can be determined by the 
InkEdit control, and since some ink can be selected by creating a box, including an 
entire line, it is clear that each word can be selected and the size of that word be 
determined while keeping the original inter-word spacing.), at a font size based on the 
average size of the electronic ink text input line ([0029], "The color and/or font size of 
the textual ink, as well as whether the textual ink should be underlined, bold, italic, 
and/or the like may be set programmatically and may be based on the attributes of 
the text around the tink object."). Arai teaches determining the size of and entry of 
handwritten data (such as the maximum or average height), and then outputting a 
candidate character of relative size (Figs. 25 and 29, col. 10, lines 12-23). 

Regarding claim 12, Gounares teaches a method according to claim 7, further 
comprising: receiving input selecting one or more words from the rendered machine- 
generated text; and displaying the electronic ink text input corresponding to the selected 
machine-generated text (Fig. 3, [0006], [0037] [0040], The examiner takes into account 
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that since some ink can be selected by creating a box and that the ink can be saved, it 
is clear that the saved ink can be recalled and replace the machine-generated text.). 

Regarding claim 13, Gounares teaches a method according to claim 12, further 
comprising: displaying machine-generated text alternatives corresponding to the 
selected one or more words ([0045]). 

Regarding claim 14, Gounares teaches a method according to claim 13, further 
comprising: receiving input selecting a displayed machine-generated text alternative; 
and replacing the selected rendered machine-generated text with the selected displayed 
machine-generated text alternative ([0045]). 

Regarding claim 15, see rejection made to claim 1 , for it addresses the method 
of this system. 

Regarding claim 16, see rejection made to claim 7, for it addresses the method 
of this system. 

Regarding claim 17, see rejection made to claim 13, for it addresses the method 
of this system. 

Regarding claim 18, see rejection made to claim 14, for it addresses the method 
of this system. 

Regarding claim 19, see rejection made to claim 1 , for it addresses the method 
of this computer-readable medium. 

Regarding claim 20, see rejection made to claim 7, for it addresses the method 
of this computer-readable medium. 

Regarding claim 21 , Gounares teaches a method of claim 1 , wherein said step 
of rendering comprises: rendering the one or more machine-generated objects such that 
a word positioning of the rendered machine-generated object or objects substantially 
corresponds to an original word positioning of the electronic ink input ([0037]). 

Regarding claim 22, see rejection made to claim 21 , for it addresses the method 
of this system. 

Regarding claim 23, see rejection made to claim 21, for it addresses the method 
of this computer-readable medium. 
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4. Claims 27-29 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Gounares et al., US 2003/0215142 A1, and further in view of Wakeam et al., 
US 2005/0041 834 A1. 

Regarding claims 27-29, Gounares teaches the ability to interpret a drawing or 
any other non-textual context that is written with the electronic ink ([0029]), and thus can 
keep positioning and spacing the same or as desired by the user ([0040]). However, 
Gounares does not explicitly state that the input is a table with rows and columns. 
Wakeam teaches using electronic ink to input a table with rows and columns (Fig. 15A 
and [01 11]). Therefore, it would be clear to one of ordinary skill in the art at the time of 
the invention to modify Gounares to include tables with rows and columns as "non- 
textual content," for further accurately editing and manipulating the electronic ink. 

5. Claims 30-32 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Gounares et al., US 2003/0215142 A1, and further in view of Geidl et al., US 
2003/0053084 A1. 

Regarding claim 30, Gounares teaches inter-word spacing and character 
recognition, to turn electronic ink into text, however, Gounares is silent on using 
normalization. Geidl teaches normalizing said inter-word spacing in response to a user- 
generated normalization command (Figs. 3 and 8, [0044] and [0059], The examiner 
takes into account that since the normalization data is saved, so that the normalization 
can be undone, it is clear that the user can control the normalization.). It would be clear 
to one of ordinary skill in the art at the time of the invention to modify Gounares to 
include "normalization," so that a more typical word processing format is created, for 
easier reading and understanding. 
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Regarding claim 31, see rejection made to claim 30, for it addresses the method 
of this system. 

Regarding claim 32, see rejection made to claim 30, for it addresses the method 
of this computer-readable medium. 

Conclusion 

6. THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time 
policy as set forth in 37 CFR 1 .136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any 
extension fee pursuant to 37 CFR 1 .136(a) will be calculated from the mailing date of 
the advisory action. In no event, however, will the statutory period for reply expire later 
than SIX MONTHS from the mailing date of this final action. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to MICHAEL VANCHY JR whose telephone number is 
(571 )270-1 1 93. The examiner can normally be reached on Monday - Friday 8:30 am - 
5:00 pm. 
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If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Bhavesh Mehta can be reached on (571) 272-7453. The fax phone number 
for the organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 

/Bhavesh M Mehta/ 

Supervisory Patent Examiner, Art Unit 2624 

Michael J. Vanchy Jr. 
Examiner, AU 2624 
(571)270-1193 
Michael.Vanchy@uspto.gov 



